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This research has as its basic premise the belfef that physicoil and mer 
skil s are highly similar, ynough so in fact that computation paradigms 
such AS the ones used in Artificial Intelligence research about predomi- 
nantly mental skills can be usefully extanded to include physical skills. 
This thesis is pursued experimental ly by the caLegorization of "juggling 
bugs" via detailed video observations* A descriptiva language for juggling 
movements is developed and a taxonomy of bugs Is presented. The remainder 
of the paper is concerned vnth an empirical deiernil nation of the character- 
istics of an ultimate theory of Juggling movements. The data presented is 
>"elevanL \.o the computational Issues of control structure^ naming, addressing 
and subprocedurization. 
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Intro duct ion 

This paper analyzes the physical skill of juggling frorn the noint of 

vif;W of the procedural paradigm of the newly developing field of Artificial 

Intel I igencG, 

The study of the niechanisms of physical or motor 
act^'vity has been a classical theme of a wide 
va''iety of scientific disciplines including 
psychology and neurophysiology. The approaches 
HTiployed in the Investigation of sensori-motor 
phenomena have ranged from the very local i 
single neuron studies to studies of global skill 
acquisition strategies, Iniportant Issues this 
research has helped to clarify include the nature 
of reflex and the precise extent to which sensory 
input controls motor activity. 

Despite vast amounts of sensorimotor data however^ we are still 

largely in the dark on important general issues ^ such as the difference 

between "physical" and "Intellectual'' activity as well as on specific 

questions such as how new physical skills are constructed from existing 

ones. The present research attempts to sharpen these IssLies by means of 

extremely detailed empirical observations and by the development 

of theoretical models. A major conclusion of the paper is that physical 

skills are considerably more "intellectual" in nature than hithertofore 

be! leved 
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The Procedural Paradlgin 

This section is a brief aside about the Artificial Intenigence 
Philosophy which underlies the experimental approach. A more exten- 
sive discussion can be found in Minsky, Papert and Winoarad 0-3), 

The rnost imDortant aspect of an^ theory or paradigm is the degree to 
which it explains, or has the potential to explain^ observed phenomena. 
Of course different paradigms use different criteria for testing to see 
whether or not a given theory 'explains^' a particular set of observations, 

Tlie procedural paradigm of Artificial Intelligence 
(A.I.) holds that knowledqe is stored internally in 
a form which can be modeled accurately by means of 
computer procedures . Hence the relevant questions 
for a given theory have to do with the control 
structure associated with the procedures, the 
mechanisms by which that control structure retrieves 
and activates procedures , the bugs (i,e, mistakes) 
encountered during activations and the process by 
which those mistakes are debugged (corrected). 



Since recent work in A. I, provides a wide variety of control and act1= 
vation strategies from which to choose , the most crucial questions for judging 
the merits of a specific theory, fo^^ example a theory of juggling^ are 
what kinds of bugs occur when a person learns to Juggle and how are these 
bugs fixed. In parti cular ,1 f It is possible to exhibit a taxonomy of 
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"juggling bugs-' and to describe precisely how these bugs are removed then 
you have g^'ven a complete theory of juggling, i,e, 

TAXONOMY + FIXES - THEORY 

Section 7 gives such a taxonomy for 3 ball cascade juggling, obtained 
by extensive analysis of video protocols of adult subjects learning to 
juggle. As we shall see later the precise description of a process by which 
observed bugs can be corrected is considerably more difficult to obtain* 
Before proceeding further however the details of the exDerimental setup 
are given. 

The Experimental Setup 

This sections explains two unusual aspects of the experimental situa^ 
tion. The first aspect is the extensive use of instruction ^ i.e. a teacher, 
during the learning period. The second Is th^^ use of video equipment to 
record the experimental trials. 

The use of a teacher was very nearly mandatory given the decision to 
study the skill of juggling. Juggling was felt to be an excellent choice 
for detailed analysis since It appears to be a very complicated skill but 
in fact requires little more than the ability to toss and catch an object 
and the ability to visually track moving objects* These prerequisite 
skills are usually highly developed in normal adults. Hence the learning 
required for juggling focuses on the recombination of existing wen- 
developed movements rather than the formation of entirely new ones. 



8 

o 

ERIC 



Unfortunately, informal experiments show that very few people learn even 
the mos:. simple kinds of juggling without the benefit of instruction* 
Although it is perhaps reasonable to conjecture that most people could 
eventually learn to juggle on their own given sufficient motivation , the 
amount of time required would most likely rule out short term learning 
experiments as well as unduly complicate the data collection problem. 
The^e problems v;ere avoided by the active use of a teacher during the 
learning trials. 

The use of the video equipment to record data was likewise essentially 
forced. It is virtually impossible to accurately record experimental trials 
which involve the study of coniplicated human movement without some sort of 
visual recording device such as a film or video technology* Video tape 1s 
more desirable than film since It requires no development time and can be 
erased and reused, 

CASCA DE vs. SHOWERS: WHICH '^ODEL DO YOU HAVE? 

The following paragraphs explain in detail the precise nature of the 
experimental task. In addition^ the first important empirical observation 
is presented. 

The subjects were randomly selected undergraduates graduate and faculty 
members of the M.KT. community ranging in age from 18 to 50, Twenty 
subjects were involved of which approximately half were video taped. The 
rest of the experiments were recorded by a combination of third party 
Qbservers and/or audio recordings. No significant difference was found in 
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the two groups. 

The experiment proceeded as fonows* after a brief juggling demon- 
stration^ the subject was asked to demonstrate, in slov^ motion, his or 
her model of juggling. 

Juggling can be defined as keeping more objects 
in the air than you have hands. For example keeping 
2 objects in the air with one hand like this 



Figure 1 




1s juggling since only one hand is involved but 2 
people tossing 4 balls back and forth simultaneously 
are not juggling since a total of 4 hands are being 
used. 

Cascade juggling, perhaps the most common and certainly tha most 
simple form of 3-ball juggling 1s illustrated by the following sequence 
of sketches: 
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It 1s interesting to note that almost all of the subjects tested djd^ 
not describe the ''cascade" model of juggling. Rather, they almost invariably 
described a form of what is cornmonly known as "showers" juggling in which 
one hand does the sane throw over and overvvhile the other hand does all of 
the catching. 



SHOWERS vs , CASCADE 




Figure 3 

The difference in the two techniques can be said (at the risk of over^- 
simplification) to lie 1n the fact that during SHOWERS a given hand either "'^ 
tosses or catches^ but never bothsWhUe in CASCADE a given hand alternately 
tosses and catches. In SHOWERS the catching hand either physically passes 
each ball to the tossing hand or tosses It hjri zontal ly to the tossing 
hand. Whereas in CASCADE the tosses are all vertical no matter which hand 
they come from,* 

This observation, interesting in its own rights is important experi- 
mentally because the initial demons trati oil each subject was given was a 

*for an excellent description and further details^ see CARLO (4) 
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demonstration of CASCADE juggling which is considerably easier to learn 
than showers* The subjects persisted in the SHOWERS model even after the 
CASCADE deiTionstration and, left to their own devices^ would have undDubteclly 
failed even more miserably than subjects left on their own with the 
CASCADE task. The important observation her is that the forniatlon of 
juggling models, be it CASCADE or SHOWERS or whatever^ is an enti rely 
mentjl process . It has nothing whatsoever to do v/ith muscles^ neural 
pathways in the usual sense or sensory feedback* Hence the first step 
in the experiment provides us with our first clue as to the relationship 
between "physicaT' and "mentaV' acts. You cannot perform a physical 
act (at least a skilled one) until you have an accurate mental model or 
representation of that act! 



Performance Data 

This section redefines the experimental task and gives performance 
data for the "typical juggler'' in terms of that definition. 

After correcting ''model errors" the subjects were led through a 
series of exercises in which they learned to control first one tosSs then 
two, then three and so on. CASCADE juggling has the nice feature that 
both a SINGLE TOSS, 

Figure 4 SINGLE TOSS 




s. 



s 







are very Msy to do. Almost everyone does them reasonably well on the 
first try. The TRIPLE TOSS is considerably more difficult and hence de- 
serves further analysis. 

The essential feature of the TRIPLE-TOSS 1s that it requires 5 after 
an Initial TOSS with the right hand*s a rapid TOSS-CATCH sequence with 
first the left and then the right hand followed by a concluding left- 
hand CATCH. The TRIPLE-TOSS Is Illustrated 1n figure 6, 



*Virtuany all juggling algorithrns are handwise reversable* 



Figure 6 
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TRIPLH TOSS_ 




TOSS by 
riqht hand 



TOSS-CATCH 
by left hand 



TOSS=CATCH 
by right hand 



Concluding CATCH 
by left hard. 



The real difficulty lies 1n the rapid TOSS-CATCH sequences, for good 
reason as we shall see later. For now we shall be content to observe that 
if we relabel these sequences, calling them EXCHANGES, then the description 
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of CASCADE juggling reduces to: 

TOSS to initialize 

EXCHANGE 
EXCHANGE 
EXCHANGE 

an Indefinite series 

■ 

of exchanges 

■ 

4 

EXCHANGE 
EXCHANGE 

CATCH anci a concluding catch 

Given, this description, it is easy to see wh> the ability to do 3 
tosses is an important step in the learning experience. At that point 
the subject perfornis the hardest step, ths .EXCHANGE, once with each 
hand: 

TOSS 
EXCHANGE 
EXCHANGE 
CATCH 

The rest of the learning process consists of fine-tuning the basic 
EXCHANGE sequence. The experimental data shows that the average person 
takes approximately 7 minutes to succesfully complete 3 tosses. Figure 
7 gives performance data for a hypothetical average juggler 1n terms of 
number of tosses achieved after a given number of minutes practice. 



(left hand) 
(right hand) 
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Pig, 7, Performanoe of the aTerage juggler, This graph is 
intended to indicate the performance of a hypothetical "average 
juggler" during the first 30 minutes of the experimental 
training period. From this perspective it raakes sense to say, 
for exMple, that the average juggler can do 2,5 tosses after 
5 minutes. It should be noted that several of the subjects 
quit ■before the 30 minutes elapsed, 5Dhis was due to (a) frus- 
tration (4 people) or (b) the aohievement of 10 or so tosses 
(5 people), Neverthelass , it is felt that the graph is repre- 
sentative of average performance. 
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Common Bugs and Their Fixes 

Most people exhibit a fairly standard sequence of bugs* The fonowing 
section discusses in detail two of the most cortimon bugs and their 
recoimendad fixes. 

TIMING BUGS 

If we suspend now the narration of the experiment and return for a 
moment to the procedural paradigmi we see that the EXCHANGE task is impor- 
tant for another set of reasons. It is here^ at the EXCHANGE sequence^ 
that the first serious bugs begin to show up in the learning process. 
These bugs usually relate In one my or another to either subtle or gross 
timing errors* Thus It Is fair to say, at the risk of precision, that 
the most common kinds of bugs in learningf'to- juggle are timings 
bugs , 

The most frequently occurring timing bug usually manifests itself as 
a variation on the following theme* 



FORWARD BUG 



F1 



gure 8 




Normal right hand 
TOSS followed by 
FORWARD left hand 
TOSS 
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The first ball is tossed correctly. It has the proper height (slightly 
higher than the forehead) and width (slightly less than shoulder wide)* The 
second balls howeverjis tossed almost directly forward with little or no 
vertical velocity. This bug appears to be due to the common tendency to 
sv/ing the forearm from the elbow when tossing an object. The resulting 
trajectory 1s then critically dependewt-on the precise Instant the * ' 
object is released by the fingers. An early release, perhaps caused by 
concern about the incoming ball, causes the second ball to go forward 
rather than up. A late release causes the ball to be thrown back towards 
the juggler* 

EARLY RELEASE LATE RELEASE Figure 9 




Of course the correct solution Is either to release the outgoing ball 
at approximately the vertical tangent point of the swing or to move the arm 
in a vertical direction only so that It doesn't matter when the ball Is 
released. The 2 "fixes" are accomplished respectively by having the subject 
Juggle while standing near (within arms reach) and facing a wall or by 
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teaching the subject a special largely vertical throwing motion known as 
"popping." 

THE WALL POPPING Figure 10 




The FORWARD TOSS bug soTietlnies occurs on the second toss but usually 
appears on the third toss or at other points of difficulty. 

THE EARLY LATE BUG 

It should be noted at this point that the FORWARD bug is relatively 
ease to fix In comparison to another member of the timing class, the 
EARLY-LATE bug. The EARLY-LATE bug occurs as the name suggests, when one 
or more of the TOSSES 1s early or late with respect to the evenly spaced 
rhythm of smooth juggling. Unevenly spaced TOSSES necessitate especially 
rapid (or slow) EXCHANGES one step later which are usually beyond the n?ach 
of beginning Jugglers. 
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EARLY-LATE BUG 




In this example an early second toss has necessitated a rushed right 
hand EXCHANGE at the same time a left hand CATCH is required. 

The fixes for the EARLY-LATE bug all involve helping the 
subject to Identify a good timing sequence for TOSSES. One way of doing 
this is a game called DROPCATCH. In DROPCATCH the subject is asked to 
execute a modified double toss in which the first ball is tossed as usual 
but the second ball is dropped or thrown ontd the ground at the last 
possible instant before the incoming ball arrives. This of course focuses 
attention on the timing involved in holding on as long as possible. With 
this newly discovered "timing point" fresh in mind (which is very similar 
to the correct time for EXCHANGE initiation) it is frequently possible to 
achieve a good TOSS rhythm on the next trial. Perhaps a better method is 
to prevent the occurrence of the EARLY-LATE bug as much as possible by 
strongly emphasizing a proper rhythm during the demonstrations. 
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A Taxonomy of Juggling Bugs 

This section presents the main body of empirical resuTts produced by 
the experiments namely a taxonomy of juggling bugs and their associated 
fixes. 

The preceeding timing bugs, FORWARD-TOSS and EARLY-LATE as well as the 
WRONG-MENTAL-MODEL bug mentioned earlier have been analyzed in detail 
(along with their associated fixes) since they are representative of the 
whole set of bugs encountered during the experiment. This set is summarized 
in the taxonomy of "juggling bugs" given in figure B2, An Important aspect 
of the taxonomy has to do with notion of a good descriptive language. In 
this case and in the protocol 1n the appendix^the names in the taxonomy 
attempt to be both a name and a description of the physical event. This 
device has two fold purpose. It greatly simplifies the difficult task of 
real-time analysis of complicated movements. It also facilitates conFiuni" 
cation about those movements. For more Information about the important 
but difficult problem of developing descriptive languages for human move- 
ment see Birdwhistle (5 )• 



22 



Figure 12A 



TOSSING BUGS 



NAME 
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A TAXONOMY OF JUGGLING BUGS 



EXAMPLE 



FIX 



FORWARD 




a) FACE A WALL 

b) POPPING 

c) DROP CATCH 



VERY FORWARD TOSS 



BACK 




POPPING (when it occurs 
on the first toss as is most 
conmon). Later occurrences 
are usually caused by a gross 
error on preceeding cycles and 
hence disappear when the 
prior error 1s fixed 



SLIGHTLY BACK TOSS 
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Figure 12B 
WIDE 



NARROW 



VERTICAL 




The next three bugs usually 
occur either as the result of 
a bad model of what a toss 
should look like or as the 
consequence of an earlier 
mistake somewhere in the 
preceeding cycles. In the 
first case the fix is a careful 
demonstration of a good toss 
along with verbal guidelines 
like "head high" or "shoulder 
width." 

In the latter case they usually 
disappear along with the 
prior mistake. (The VERTICAl 
bug has a separate name because 
it is so disruptive when it 
occurs that it deserves special 
attention) . 
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Figure igc 
COLLISION 




a) Demonstrate the difference 
between underthrowing and 
overthrowing, 

b) Pretend there's a large 
pipe beside and ''inside" the 
trajectory of the incoming 
ball into which you must 
throw the outgoing ball* 



CAN'T RELEASE 
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This bug most frequently 
occurs on the 4th toss and 
may perhaps be due to the 
pedagogical sequence used 
w^n'ch emphasizes "getting to 
3" or to an overly cautious 
"dynamic lookahead" ability 
iwhich predicts disaster on 
the upcoming toss* In any 
event the fix Is to force the 
occurrence of the Inhibited 
toss by either changing the 
toss cue via instructions 
like "don't throw until you 
hear me shout NOW " (this is 
a variant of DROPCATCH) or 
by removing the fear of 
failure by instructions like 
"don't worry about catching it 
for now. Just throw it*" 
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CATCHING BUGS 



Figure 12D 



NAME 



EXAMPLE 



FIX 



FINGERNAIL 




Ihe catching errors shown 
here almost always stem 
from poorly executed 
previous toss or sequence 
of tosses. Hence the 
fix in most cases involved 
correcting the offending 
TOSS. 



HANDSLIP 
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Figure 1 2E 



CHESTCATCH 




SWIVELCATCH 

(sever'e hip rotation but no step) 



(Usually found only after 
serious BACK or timing bugs) 



LUNGECATCH 

(involved one or more steps, lunges, etc. i.e., a last ditch attempt) 
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TIMING BUGS 



Figure 12F 



NAME 



[{XAMPLE 



EARLY 



LATE 






Although all of the bugs 
exhibited so far are, at 
some level , accurately 
described as timing bugs, 
some are more directly 
concerned with the sequencing 
of major events , such as 
tosses, rather than details 
within a given event such 
as a release within a given 
tosSi Hence they deserve 
special attention and names. 
The fixes In all cases in- 
volve establishing a good 
major event sequence by 
games like DROPCATCH. coun- 
ting out louda demonstrations 5 
etc. 
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Figure 12G 



SLAP 



iV 



A 

2 




In the SLAP bug the outgoing 
TOSS is so late that there 
is no time left to throw. 
In a desperate attempt to 
both throw and catch at the 
same instant the hand 
compromises both tasks by 
"slapping" (while still 
holding onto) the supposed 
outgoing ball irito the 
Incoming bal 1 . The f i x 
for SLAPPING is to forbid 
the subject to do it (since 
1 t is a voluntary act) . 
The ball must fee either 
caught or allowed to drop 
untouched. This helps to 
focus attention on the proper 
EXCHANGE initiation point. 
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The Outj ines of A a)tn|n 

The preceeding sections of this paper were concerned with the 
presentation of empirical data about the skill of juggling approached from 
6 computational point of view. From that point of view the sKperiinen cal 
observations with respect to the role of modGl in physical skills, the most 
common and most severe bugs and associated fixes, as well as the notion of 
a complete taxonomy of bugs all have to do with what computational e):perts 
would call software aspects of juggling. By definition however, the compu- 
tational paradigm consists of a set of software instructions (by which the 
programmer fulfills his model of the problem, creates bugs, etc.) and^ a 
set of hardwara devices by which those instructions are interpreted and 
executed. For people of course the hardware devices by which movement 
instructions are executed are muscles, neural networks, the motor cortex, 
and so on. 

It is not possible at present to give a complete theory of this hard- 
ware device for physical "cormiands'J It is difficult enough to give detailed 
theories about very small components of what might be called the "physical 
computer" part of the human body. The rest of this paper Is concerned with 
establishing empirical constraints on the range of theories which might be 
offered for the various components of such a computer. The Issues considered 
have to do with timing constraints, potential control structures, naming 
and the construction of subroutines. 
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It should be clear ^ computationally sptiakinq, that juqqllnq is a real 
time process and further, that the constraints imposed by the physics 
involved are fairly severe. The following discussion has as i\:s goal a 
clear formulation of the timing constraints faced by an accomplished .iuggle 
as he performs his routine. The constraints derivej here combined with 
what is known of human resDonse times should be of considerable value in 
designing a control structure for a theory of Jugyling movements. 

Human Co nstra ints 

It is apparently tnje that any willed skeletal movement takes approxi- 
mately 200 ms. to initiate. That is to say, when your head tells any part 
of your body to move^ including the eyes ^ on the order of 200 ms elapse 
before the movement actually begins. Although there is some variation 
depending on the task, the individual ^ and to some extent the amount of 
practice, the 200 ms elapse latency is essentially Invariant^ part-^'cularly 
for large movements of the kind involved in Juggling. Likewise the maxim im 
acceleration for the hand is approximately 2400 in, /sec , 

These parameters can be verified emp1:"icial ly by the 
following two experiments: 

Try to catch d ruler dropped (by someone else) between 
your almost closed fingers. The zero mark should be 
even with the top of the hand. The hand should be 
resting on some fixed object so 1t can't "chase" the 
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ruler. The fingers will usually grasp the ruler some- 
where between the 7 and 8 inch marks which corresponds 
roughly to a 200 ms delay. This explains why it is 
nearly Impossible to a catch a 6^' dollar bill in the 
popular version of the experirTient. 
The second experiment involves trying to swat a ruler 
dropped past some flat surface like a table. The hand 
is positioned 3" from the edge of the table and moves, 
wiien the ruler dropped tin a direction which is 
horizontal to the table. The ruler 1s held so that 
the end is even with the top of the table. With a 
little practice you can just nick the end of the 
ri ler as it goes by. Since the ruler falls 12" in 
^-250 ms, the hand moves 3" in 50 ni^ , assuming a 
200 ms latency. This corrt^ ponds to an deceleration 
of 2400 in. /sec. . These examples are due to Lacy (6), 

Ballistic Const raints 

Given that the hand ope^^ates with a 200 ms latency and can accelarate 

2 

at no more than 2400 in./sec. ^ how do these constraints compare to 
the ones imposed by the laws of physics? The first step is to determine 
the velocity of the ball in normal catching regions* For a person 6 feet 
tallj a to^s typically rises to a maximum height of 6 1/2 feet and 1s usually 
caught at slightly more than shoulder level. This situation can be modeled 
from the timing point of view as a ball dropped from a height of 6 1/2 feet 
and caught at a height of 5 1/2 feet* Thus the ball reaches a velocity of 
96 in. /sec* and hence requires 250 ms to travel the 12 inches from the top 
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cf its arc to the level at whirh it usually caught. If for some reason 

the distance traveled becomes as much as 24 inches the velocity of the 

ball increases to 136 in. /sec, so that only 350 ms are required to cover 
the longer distance. 

Basic Cycle 

It shoulu be noted that thc3 hand which Is about to catch the incoming 
ball (i.e. in our model the dropped ball) H currently occupied with tossing 
the outgoing ball and hence at the conclusion of that toss is very close to 
v:here it should be in order to catch the incoming ball. In fact 1f atten- 
tion is focused on say the jugglers left hand the following pattern of move= 
ments can be observed. 
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and the shift part of that cycle has to cover only 3 or 4 inches for most 
tosses. By the second ruler experiment it seerns reasonable to believe the 
hand can cover such distances within the available 250 ms and hence that 
a kind of control structure one might call a "reaction" theory could 
support juggling niovenients satisfactorily. Such a theory would claim, for 
example, that at the end of the TOSS movement the eyes perceived the position 
of the incoming ball and "reacted" by issuing a cQjTiniand to move the hand 
under the ball. Likewise the actual contact of the hand and the ball causes 
another reaction in the forni of a GRASP movement. The central t@nent of 
a reaction theory of movement control is that the commands which initiate 
movements are issued in response to rather than in anticipation of external 
events • 

An Antic ipation Theory 

Unfortunately the preceeding analysis does not include latency times 
for the various movements and p..z yet says nothing about the control of eye 
movements* These considerations make 1t obvious that a more complicated 
"anticipation" theory will be required for any control structure the overan 
theory might select. For example ^figure 1€ presents a frame by frame analysis 
of a brief (8 toss) Juggling sequence. This analysis shows that the most 
crucial part of the EXCHANGE ^ the SHIFT movement, lasts on the 
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Figure 14 

Basic Cycle 
Timing 




4^ 



{I023ms^') 



(Ball travels 1 ft in 250 



TOSS (360ms) 



SHIFT movement initiated here early 

in the TOSS movement 



REST (360ms) 



average 330 ms after i t begins . Of course there is a theoretical question 
as to whether or not the 330 ms consists of a 200 ms wait and a 130 ms move 
or consists entirely of a 330 ms move. The empirical evidence from the video 
tape is clear on that point however. There is no observable pause at the 
"nd of tne TOSS movement and certainly none of 200 ms duratlDn, Rather 
the whole TOSS, RELEASE, SHIFT, CONTACT, HOME sequence appears to be one 
smooth inovement* 
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LEPT mm 



T 



(11) upaweep 



Release ~ 

(7) Pogltion for Catch 
ContaGt 



^(5) G-raspl 
(4a) Hoine ft Rest 



(11) Upsweep 



Releasa^ 



(12) Position for Cateh 
Oontact'^^ 



(4) Graspl 
(41) Home ^ Rest 



(10) Upsv/aep 



(9) Position for Catoh 
Contact— 



(5) Graepf 

Home (25) 
(39) & 

Rest (14) 



(11) Upsweep 



Release- 



(12) Position for Catah 
Contaet— 



(42) 



(6 )" &rasp| 

Home (35) 
& 

Reit (9) 



RIGHT HANTi 



DoTOeweep (9) 



Upsweep (11) 



■ Release 



Home & Rest (4u) 



Upsweep (12) 



(51) 



One 
Cycle 



^ --^ Releaaa 

Position for Catch (iu) 



Home & Rest (43) 



Upsweep (10) 

.^-^^-^ ^ — ■■ ■■ Release 

foiitlon for Gat^ (10) 
— - wont act 



I Grasp (5) 
Home & Reat (42) 



Upaweep (10) 

^ ^ Rt lease 

Position for Catch (g) 
---Contact 



I Gpasp (6) 
Home & Rest (42) 
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Flg. 15. Timi nq Anajysis of Bas 1 s Cascade 
Juqgl 1 ng CycTTiFor^ an accompi 1 shed JuggTer) 
Times are given 1n terms of video frames and 
are indicated in parentheses for convenience 
One frame * 1/30 sec « 33ms. So for eKample 
the 1st UPSWEEP by the right hand tools 
11 frameSi i.e« 363 ms. 



The only way this could have occurred from a control point of view is for the 
SHIFT movement to have been initiated some 160 ms into the TOSS movements the 
GRASP movement to have initiated 130 ms into the SHIFT movement, etc. (see 
figure 5l)6)* 

To return to the theoretical discussion ^ the issue becomes forced when 
eye movements are considered. At least one eye fixation 1s required to deter 
mine the trajectory of the ball 1n flight. Yet eye movements also have a 
200 ms latency. So seeing the ball and causing the arm to catch It Involves 
at least a 400 ms delay assuming an instantaneous trajectory calculation 
and zero time for the arm movement. But the model allows only 250 ms for 
the ball to fall the 12 Inches Involved In a normal catch. Doubling this 
distance adds only TOO ms or so to the time available. Thus it Is clear 
that the SHIFT movement is anticipatory In nature in the sense that It 
must have been '■planned,'' i.e., initiated^ during a prior movement* Notice 
that the preceding discussion does not consider the posslbnity of quick- 
reaction loW'-level feedback loops which obviously could affect the details 
of the analysis. Nevertheless the primary conclusion still stands. Any 
theory of juggling movements must contain a control structure which is 
capable of supporting parallel, real-time, events of an "anticipatory re- 
sponse" nature. 
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THE BASIC CYCLE FROM THE CONTROL POINT OF VIEW 



MOVEMENT TIMES 



INITlAnON TIMES 



Toss Begins 



(360 ms) 



Release Occurs 
Shift Begins 



(330 ms 



Contact Occurs Home Begins 
'Jrasp Begins 

(165 ms) 



(1023 ms) 



300 - 
400 » 



1 300 • - 



Toss Initialed 



(200 ms) 



Shift Initiated 



(200 ms) 



Grasp Initiated 
Home Initiated 



(200 rns) 
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Bugs Come In Bunches 

The next experirnental observation also has to do with timing Information 
but in a dffferent sense. The observation -is that bugs apparently come in 
bunches 5 at least that is true for the juggling ,/ariety anyway. Its probably 
safe to say that above the DOUBLE TOSS level most of the subjects were initially 
grappling with two or more simultaneous bugs. One frGquent combination was 
EARLY, LATE/FORWARD. The protocol in Appendix I contains many other examples. 

This observation is significant for both theoretical and pedagogical 
reasons. One of the most important differences between mental and physical 
events is the fact that all physical events reduce ultimately to some pattern 
of muscle start and stop times. Although it could llkewisa be said that 
all mental events reduce ultimately to somatblng like current flowsin some 
deep sense 1t seems to be true that physical events are considerable more : 
time -dependant than mental events. We have seen for example the whole 
taxonomy of bugs which can be generated from subtle shifts In the timing 
of events in the basic juggling cycle. It 1s perhaps reasonable to conjec» 
ture then that simultaneous bugs are due to a combination of tlitiing mis-speci- 
fications in the learning process and the narrow range of permissible 
specifications afforded by physical constraints. The Important theoretical 
implication is that any theory of movement must have a mechanism, perhaps 
a whole language^ which is capable of describing and modifying timing events 
at the millisecond level. 

Pedagogical ly the observation is important because if, as conjectured. 
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juggling is a reasonable representative of physical skills in general, then 
the indicated experimental direction is the creation of learning environ-^ 
ments in v;hich the same bugs occur^ but one at a tijm . For jugglings this 
might take the form of a machine which allows EXCHANGE practice in slow 
motion, or as a separate entity, EXCHANGE bugs could then be dealt with 
one at a time independently of the rest of the process. 

The B r e a k t h r 0 u g h_ P h e n ome n o n 

The single most surprising discovery made during the eKperiment was 
that for most individuals progress ^ as measured by either the nimiber of the 
quality of successful tosses 5 was not at all continuous but .rather ^appeared 
to consist of a series of breakthrouqhs or plateaus. These breakthroughs were 
ncrt initially stable^ frequently being attainable for only one or 
two trials, but became more frequent and stable over time. The really 
astonishing piece of information is that the magnitude (measured 1n tosses) 
of the breakthrough was usually 2-4 times that of the previous level! 
Jumps from 3 tosses to 10 or 11 tosses were common- Sea for example the 
sixth minute of SI or the eleventh minute of S2 1n figure 17, Almost every 
subject in the experiment exhibited a breakthrough which virtually doubled 
the previous best effort* 

One explanation of this observation is that several bugs vanished or 
were temporarily overcome simultaneously thereby allowing a draniatic break- 
through to occur* The fact that the breakthrough 1s not Initially stable 
but improves with time suggests that some form of trial and error or hin- 
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cliiTibing search is going on at the lower levels of timing specification. 
This argues against a strictly symbolic naming/addressing mechanism in the 
overall theory. 
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It's Hard To Give Yourself Advice 

Here's an observation which is true only sometimes and is Intriguing 
both when 1t does and when it doesn't apply. The question is why is it 
hard to give yourself advice when learning new physical skills. The most 
extreme example of this situation is the disastrousfJ'bl ind trials" approach 
wherein the subject feverishly tries the task over and over without even 
taking the trouble to describe his mistakes, let alone advise himself on 
how to fix them. 

In many cases though , thoughtful analysis has 
produced a reasonably accurate description of the 
mistake but it's still difficult to translate that 
information into corrective action. For example, 
most people can sucessfully tell themselves to 
"toss higher" (to gain more time) but apparently 
it's quite difficult for many people to tell 
themselves "toss later" or "toss right before 



It's also interesting to note that frequently the best advice you can 
give yourself appears on the surface to have nothing to do with the task 
at hand but in reality corrects exactly that portion of the movement which 
was previously erroneously specified. For example in tennis the advice 
"Serve as though you were trying to throw your racquet away but hold on " 
frequently helps the novice master the service movement more quickly. In 
juggling the advice "Practice while facing a wall" is frequently useful for 
correcting the FORWARD and other bugs. 
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The theoretical implications of this observation have to do with the 
rrechanisms by which existing movement specifications can be brought to bear 
on the task of learning new movements. The fact that existing knowledge Is 
relevant to similar task should be obvious and has been demonstrated experi- 
mentally by tasks like learning to write with the non-preferred hand. The 
apparent ability to advise yourself on certain tasks but not on others 
raises questions about the mechanism by which advice is accomplished and 
the degree to which it Is a symbolic process. Thus the overall theory of 
physical movement must explain why the symbolic advice "throw this way" 
(in the serve example) is useful and can be acted upons but the equally 
symbolic advice "toss earlier" (in juggling) is only marnlnally useful. 
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The Construction of Subroutines 

A constant theme which runs throughout the experimental data has to 
do with the question of how "chunks" of movements are grouped Into larger 
chunks. Computationally this is the Issue of sub-procedurization or 
subroutine construction^ It appears to be perhaps the most central issue 
;n designing a theory of physical movement as well as one of the most 
difficult. 

Part of the difftculty lies in ascertaining the real nrimitives 
of movement specification and the degree to which the process is 
symbolic. At least some of the problems posed by this gap in our knowledg 
can be avoided if we assume that for advanced skills (like juggling) the 
relevant aspects of the component movemervts are predominantly symbolic and 
hence can be treated like ordinary subroutines* Of course this assumption 
which may be entirely unwarranted , merely postpones the issue of what 
happens inside a given subroutine. However it allows us to begin the task 
of describing the overall learning process from a symbolic point of view. 

For example^in juggling, the basic learning process apparently centers 
around combining the first part of an existing TOSS subroutine 

TOSS 
DOWNSWEEP 
UPSWEEP 
FLIP 

FOLLOWTHROUGH 
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with the body of an existing CATCH subroutine 

CATCH 
TRACK 
MOVE-UNDER 
FLEE 
GRASP 

and inserting MOVE'S as appropriate to produce the EXCHANGE procedure 

EXCHANGE 
TOSS* 
MOVE 
CATCH 
MOVE 

where TOSS* is TOSS minus the FOLLOW-THROUGH line- 

Notice that the final version EXCHANGE cannot be a simple linear 
combination of TOSS, MOVE and CATCH. As previously discussed, the latency 
times and the real world constraints rule this out. It 1s certainly true 
however that, as in Sussman's thesis (see reference 7) the linear approxi- 
mation subroutine is a good initial modej from which to start, I.e. there 
good chance that the debugging process will converge to the desired final 
structure. The linear model idea also brings to mind the discussion of 
cascade juggling models In section 4, Sussman and Goldstein (8 ) also 
provide clues as to how that convergence process might go in different 
problem domains. The degree to which those methods apply to the domain 
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Of movement depends a great deal on the extent to which movement primitives 
are si^mboHc. Issues such as annotation, Invocation and patching however, 
appear to be good starting points for the discussion of whether or not the 
Goldstein/Sussman theories can be applied to physical procedures. In any 
event it appears to be true at least at the more advanced levels, that 
physical movements can successfuny be treated as subroutines from b 
cornputational point of view. 
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Summary and Conclusion 

In sunmary, we have seen in considerable detail the extent to which 
the computational paradigm can be applied to the skill of Juggling, a skill 
which is hopefuny representative of niost forms of higher-level skill. The 
discussion initially focused on the external or performance aspects of 
juggling acquisition. A descriptive language for juggling movements^ 
formulated in bug/fix terminology was developed to the point of exhibiting 
an extensive taxonorny of cascade juggling bugs* 

The latter part of the paper was concerned with establishing the gross 
outlines of a theory of the internal mechanisms by which movement commands 
are interpreted and executed* Empirical evidence which was found useful 
1n this regard included an observation about the Importance of having a 
model of the physical task at hand^ a study of human ballistic constraints* 
the unfortunate fact that bugs come in bunches^ the very surprising break- 
through phenomena and the intriguingly difficult task of advising yourself 
during physical skill acquisition. 

This evidence shows that while physical skills have an obvious symbolic 
component, the precise extent to which the overall theory should be symbo- 
lically oriented is not clear* Evidence which supports the symbolic point 
of view includes the data on models and the successful instances of advice. 
Evidence which argues against a completely symbolic theory Includes 
the unsuccessful advice cases as well as the "trial-and-error-like" 
parameter search which is assumed to underlie the breakthrough phenomenon- 
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The issue of control structure is somewhat more clear-cut. Human and 
physical constraints make it obvious that a theory of movemint must Include 
a control regime which is capable of supporting real-times parallel events 
of an anticipatory nature. There rnust also be a mechanism for describing 
and modifying event tires at the millisecond level. The present experiment 
yields little information about feedback mechanisms. 

The theoretical outline concludes with the observation that the central 
issue appears to revolve around the problem of how existing movement patterns 
(subroutines) are combined to form new moveinents* This statement is confirmed 
by a subroutine analysis of the juggling learning task. The procedural 
modification theories of Sussman and Goldstein appear to be partially 
relevant to physical skill acquisition from that point of view. Hence the 
issues of invocation 5 annotation s and self-debugging appear to be good 
topics for further research. The non-symbol 1c nature of movement primitives 
appears to be a central Issue in such endeavors. Despite the existence of 
these problems however, it is felt that the primary conclusions as to the 
similarities of physical and mental activity and the relevance of the 
computational paradigm are thoroughly justified. 
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APPENDIX 

Protocol for SI* 



1) E-Show me your model of juggling. Make the bags move as though you were 
juggling, 

2) Sl-Well let's see. You throw this one (1,e, the left one) in the aiv*. 
When it reaches its high point you then begin (the transfer operation?) 

3) E-Just make them move through the motions. 

4) SI -This one goes up (1,e, the left one) and this one goes over (i.e. the 
right one) . 

Tosses L-4Rs passes R^L. 

5) E-You have the m^l of juggling that most people have^ namely this 
(demonstrates "shower" Juggling). You mtl juggle that way but it's 
much harder. Vm going to teach you a new kind of juggling. Let's 
get some terms. This 1s a toss (demonstrates a toss). This is a pass 
(demonstrates a nass). There's no passing in the juggling I'm about 
to do. It's all tosses (demonstrates cascade juggling), 

6) Sl-Un huh. 

7) E-I'd like for you to do this. One in each hand TOSS R L, TOSS L R, 
Now notice I don't want simultaneous tosses (demonstrates) and I don't 
want almost simultaneous (demonstrates). I want a distinct cadence, 
tosss toss. 

8) unintelligible 

9) Sl-L-^R, 

R^L^ pass^ dropped* 

10) E-You |j^®d 

11) Sl-Yeah, 

12) L-*R "handsllp" 
R^L wlde^ forward, 

13) L-^R fingernail 

R** L wide J forward* 

14) E-Toss the second one more like that (demonstration) 

Sl-Tm used to tossing with this hand (left) but not this one (I.e. right), 

E-Toss it in a nice parabolic arc. 

*In this protocol SI is the subject* E Is the experimintart L^R Is a toss from 
the left hand to the right handp^means a satisfactory toss and terms like "hand- 
slip", "widii" "forward" the names of specific bugs from the taxonomy* pgs.17-22* 
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15) R^L / means satisfactory TOSS), 

16) R^L-^ 

17) E-Right, now do the exchange. 

18) R-^L slightly forwards handslip 

L-* R back, "pinch catch" (i.e. thumb and first two fingers). 

19) L^R^ 

R-»L slightly wide, slightly forward, 

20) E-O.K.i quit. That took exactly 2 1/2 minutes. Now do the same thing 
again but hold the third beanbag in your hand. Just hold it there, 
don't toss it (demonstration), 

21) L^R/ 
R-*L low. 

22) L-^R ^ 
E-O.K.. 



23) L R back, dropped. 
R L very forward. 

E-O.K. 

24) L^R ^ 

R-* L forward 

Sl-I have trouble tossing with this (right) hand. 

25) L-*R ^ 
R-*L ^ 

E-Please talk out loud. 

26) L-^R ^ 

R"»L fingernail 

Sl-I can really toss well with my left hand but my right hand (isn't 
too coordinated?) . 

27) E-Looks good to to. Now what I'd like you to do is when you're at the 
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stage when the second one^s coming down, toss the third one (demonstrates) 
It goes like this (slow demonstration). 

28) L-^R slightly forward 
R'^l. very forward , dropped 

L^R wide and forward, caught by stepping forward, 
E- Almost . 

29) L^R ^ 

R^L very forward i very wide, stepped forward, dropped 
L--^R caught directly over shoulder due to previous step. 

E-Comment to cameraman. 

30) L->R ^ 
R^L vertical 

L^R very fonvard, lungecatch 

E-Your second toss went straight up and straight down. 
SI -Yeah 

31) L^R ^ 

R^L slightly back, dropped 
L^R slightly forward 

E-Ah you had it but you dropped the second one, 
Sl-It's hard for me (to concentrate on catching?)* 

32) L^R ^ 

R^L slightly back, dropped 
L-^R very forward, lungecatch 

E-yoii*m^ig4tfiiog® very nice cadence there. RfflfeBiber that cadence, 

33) L^R^ 

R^L slightly back, chestcatch 
L^R fingernan 

E-O.K*, quit. That took you a total of 3 minutes^ 35 seconds, 

34) Normally we have people stop here because there's about 3 Important 
points In Juggllngi 3, 10 and 100, But you got there so quickly we'd 
like to have you go on. Let's see how quickly you get to 10, 
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E-'Explains how to keep going, the apex rule for timing the next toss, 
and about stopping* 

Sl-Also it helps to throw it rially high so ^cu have tifne to think 
about it. 

E^Rightj keep talking out loud, 

35) L-^L high, vertical, caught with left hand (unintelligible) 

36) L"^R very high, back (unintelligible) 

37) L^R high back 

R^L forward, fingernail 

SI -It's like throwing tennis serves. 

38) L-^R high 5 slightly back, dropped 

39) L^R ^ 

R^L late, caught with R hand. 

40) L-^ R vertical* chestcatch, 

41) E"Notice that it comes and goes. All learning gees like that. Every- 
thing goes wrong then it comes back for a couple of tlrneSi then , * . 

SI -I know how that is. 

42) L-^R fingernailed 
R^L late 

R back wide 5 dropped 
R^L very late, just rolled out of his hand while catching the third 
toss (slapdrop?)- 

E-0*K,, you almost got rid . of the fourth toss. 

43) L-^R back, handslip 
R-^L late^ very forward 

44) 1) R 

2) R'^L very forward * lungecatch 

3) L-^R late 

4) R^L late, back, leanback catch 

5) L^R very forward, lungecatch 

6) R^L very fomardi lungecatch 



7) L=9R (not visible) 

8) R^^L (partly visible) slightly back 

9) L^R (not visible) 

10) R-'^L (partly visible) lungecatch bounced loose, chestcatch 

11) L-^R very back, stepback-catch . 

45) E-That took a total of 6 minutes 15 seconds. O.K., let's see what fine 
timing looks like. Comments on juggling as an unstable (in the 
mathematical sense) process (advice about "laying'* a toss up beside the 
incoming one and a demonstration), 

46) L^R 

R^L late, vertical, caught with R 
(unintelligible) 

47) L->Rw^ 

R->L late 5 vertical , caught with R 

A little more flip, you don't v/ant to v^ait so long, 

48) L^Rw^ 

R^L forward^ lungecatch 

E-You have too much followthrough in your left hand there. 

49) L^R slightly back, fingernail 
R^L forward, lungecatch 

E-Righti much more like that. 

50) L^R^ 

R^L forwards lungecatch 

51) L*^R 

R-^L Tatei forward, lungecatch. 

52) E-Advice ref. "popping "theory, deinonstration . 

53) Sl-Practices popping (six times) 

E-O.K, Hit it. You've already done 11, 

^ 54) L4R^ 

R'^L forward, lungecatch 
(un1 ntell igl ble) 

55) L4R^ 

R-^L slightly wide. 
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56 ) L R ^ 
R->L wide. 

57) L^^vRv^ 

R=^L slightly forward^ sligluly wide 
(unintel li gi ble ) . 

58) L^>R^ 
(unintelligible) 

59) L^R 
R^L 

E-0,K.. Gq ahoac. Ycu've done 12 dl ren^y. 

60) L^R vertlcaU. caught with L. 

61) L-'^R vertical caught with L 

62) L^R low, handslip 

R^L later vertical caught with R. 

SI -unintelli gi ble . 

63) L^R late 
R-^L late 

L^R slapthrow, both dropped 

E» Don't slap 1t. Toss it higher, 

64) L^r/ 

R-^L back , handsl ip 

L^R vertical^ caught with L 

SI -(Getting 1n trouble because I'm not getting theni out far enough??) 

65) L-^R fingernail 
R^L ^ 

L^R very low, very forward , lungecatch 
E- You keep getting lower. 
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66) 1) L^R-^ 

2) R->L late, forward 

3) L-^R fonvards lungecatch 

4) R^L back 

5) L-^R almost vertical, slightly low 

6) R-^L late 

7) L^R 

8) R-'^'L late 5 chestcatcha dropped 

9) L-^R two handed catch 

S1-0,K.. I'm not getting the tosses (unintelligible). 

E-That's O.K,, you're getting good. Keep doing that and you'll cle 
it up yourself. 

67) 1) L-^Rv^' 

2) R^ forward p lungecatch 

3.) L^R slightly vertical ? handslip 

4) R^L late, two handed catch 

E"Most people don't use the height enough to cheat and get more tim 
up there, 

68) 1) fingernail 

2) R^L forwards lungecatch 

3) L-^R forward^ lungecatch 

4) R-^L very wide^ leancatch 

5) R not visibl e 

6) R^L not visible 

7) L^R not visible 
(unintel ligible) . 

69) L R vertical . 

70) 1 ) L^R ^ 

2) R-^L slightly forv/ard and left 

3) L^R 1^ 

4) R=^L wide, rotates left to catch it 

5) L"^R verticals rotates even further left 

6) R-^L not visible 

7) L^R not visible, apparently slightly vertical 

8) R->L forward 

9) L^R verticaU forward, lungecatch, dropped 
10) R'^L forward, lungecatch 

E-Looks good to me* 

SI -Still moving around too much* 
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71) I) L-^Rw/ 

2) R-^L forward 

3) L"^R forward, leancatch 

4) R-^L forward, lungecatch 

5) L-t R forward 5 leancatch 

6) R^L forward, handslip 

7) L^R forward, lungecatch 

8) R^L very back, dropped, 

72) E-0,K,5 you do in fact have some Indication of a fnigration bug. The 
way you fix a migration bug is face a wall (demonstration, more advice 
ref, migration bug) 

73) (now agai nst wal 1 ) 

R wide s back 

74) L^R^ 
R^L passesi 

75) L-?^R wide, fingernail 

L back * handslip 
L-^ R late, low^ hits the ^^al 1 
(unintell Igible) 

76) 1 ) R fingernail 

2) R^Lv^ 

3) L'^^ R fingernail 

4) R^L wide, leancatch, fingernail 

5) L^R forward 

6) R"^L forward, leancatch 

7) R back, chestcatch, dropped 

8) R->L wide, fingernail 

9) L-^R slightly vertical 

E-The one that got you was the one that came back* 
Sl»Yep. 

77) l^R forward 
R^L wide 

78) LtR vertical, caught with L 

E*They tend to go straight up and down. 

79) L-^R handslip 

R-^L verticals caught with 
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BO) L-^Ru^ 

R^L verticaU fingernail, chestcatch, leanback 
L^R forward j handslip 
R-^L leancatch 
(unintelligible) 

81 ) L-^ R fingernai 1 

R forward 
R handsli p 

L-?R verticaU forward^ almost hit the v^all 
R^L wides forward, leancatch, 

82) L^Rv^ 
R^; L ^ 

L^R forward, vertical 

R^l slightly v/ide^ handslip 

L-^R early forward, caught against wall 

R-^ L handslip . 

83) E-0,K,, quit wasting film on hinu That took a total of 11 minutes 
Sl-I was just getting the hang of 1t, 
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